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V  ABSTRACT 


I  -This  note  presents  a  brute  force  approach  to  linearly  constrained  programming 
in  non-convex  optimization;  Uur  aim  here  is  to  illustrate  a  general  methodology 
which  can  be  applied  to  construct  tailor-made  algorithms  in  specific  applications. 

In  essence,  the  facial  decomposition  method  constructs  a  non-redundant  list 
of  all  faces  of  the  polyhedral  set  P  c:  Rn.  Each  face  is  characterized  by  a 
linear  program  in  a  given  af.fine  subspace  of  Rn.  This  list  is  conveniently 

(displayed  in  a  tree  structure  which  represents  the  set  of  nodes  to  be  searched 
(typically  for  optimality). 
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ABSTRACT 


This  note  presents  a  brute  force  approach  to  linearly 
constrained  programming  in  non-convex  optimization;  our  aim 
here  is  to  illustrate  a  general  methodology  which  can  be 
applied  to  construct  tailor-made  algorithms  in  specific 
applications . 

In  essence,  the  facial  decomposition  method  constructs 
a  non-redundant  list  of  all  faces  of  the  polyhedral  set 
P  c  X  n  .  Each  face  is  characterized  by  a  linear  program  in  a 
given  affine  subspace  of  Rn  .  This  list  is  conveniently  dis¬ 
played  in  a  tree  structure  which  represents  the  set  of  nodes  to 
be  searched  (typically  for  optimality). 


The  Facial  Decomposition  Method 
by  Claude-Alain  Burdet 


0)  Generalities 

This  note  presents  a  brute  force  approach  to  linearly  constrained 
programming  which  has  proved  successful  in  non-conve:c  optimisation  for 
problems  of  moderate  size;  our  aim  here  is  to  illustrate  a  general  meth¬ 
odology  which  (like  the  branch  and  bound  idea,  for  instance)  can  be  applied 
to  construct  tailor-made  algorithms  in  specific  applications. 

In  essence,  the  facial  decomposition  method  constructs  a  non-redundant 
list  of  all  the  k-dimensional  (0  <  k  <  n)  faces  of  the  polyhedral  set 

,  [1].  Each  face  is  characterized  by  a  linear  program  in  a  given 
affine  aubspace  of  K  n  . 

The  set  of  all  faces  of  a  polyhedron  P  is  a  complete  lattice  and, 
in  particular,  one  has  the  property: 

A  face  of  a  face  F  of  P  is  a  (sub) face  of  P  ;  thus, 
the  set  inclusion  induces  a  finite  tree  structure  on  the  set 
of  all  feasible  solutions  (i.e.,  P  ),  each  node  correspond¬ 
ing  to  a  face  of  P  . 

A  method  is  presented  in  [1]  to  generate  a  non-redundant  list  of 
linear  programs,  each  belonging  to  a  face  of  P  .  This  list  is  conveni¬ 
ently  displayed  in  a  tree  structure  which  represents  the  set  of  nodes  to 
be  searched  (typically  for  optimality) ;  this  constitutes 
the  face  decomposition  method. 

Unlike  branch  and  bound  which  is  a  two  criterion  (feasibility  and 
optimality)  search,  the  facial  decomposition  method  represents  a  one 


2 


criterion  tree  search  approach  where  feasibility  with  respect  to  P  is 
automatically  satisfied. 

In  practice  the  face  structure  of  a  polyhedron  is  an  elusive  concept 
because  it  may  be  radically  altered  by  the  influence  of  numerical  errors ; 
typically  numerical  perturbations  due  to  the  finite  accuracy  of  the  com¬ 
putations  will  introduce  a  multitude  of  additional  "faces"  whenever  degen¬ 
eracy  occurs.  A  similar  phenomenon  may  also  be  present  due  to  inaccuracy 
of  the  original  data.  In  order  to  remedy  tills  situation,  the  facial 
decomposition  approach  makes  use  of  three  concepts:  relevant,,  pseudo- 
degenerate  .  and  redundant  Inequalities. 

In  fact  this  trichotomy  introduces  a  control  parameter  which  can  be 
used  to  limit  the  size  of  the  tree;  one  may  in  this  manner  guide  the 
search  within  a  subtree  towards  rapidly  finding  a  good  solution.  In  a 
second  effort,  global  optimality  can  be  attained  by  searching  the  rest 
of  the  tree. 

Applications  of  the  facial  decomposition  method  are  found  in  (opti¬ 
mization)  problems  of  various  types;  in  order  to  be  decomposed  a  problem 
must  possess  the  following  property  tt  : 

The  relative  interior  rel  int  F  of  an  arbitrary 
face  F  of  P  can  always  be  fathomed  (i.e»,  discarded 
from  further  consideration). 

For  instance  in  concave,  and  in  zero-one  programming,  it  is  known  a  priori 
that  the  optimal  solution  is  an  extreme  point  of  P  and  therefore  not 
interior  to  any  face.  Another  application  for  quadratic  programming  is 
presented  in  { 2] . 
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1)  Minimal  sets 

The  Idea  behind  the  construction  of  facial  decompositions  is  quite 
simple;  it  rests  on  the  fact  that  a  linear  program  with  variables 
xl’**,,Xn  —  ®  (including  slacks)  may  contain  redundant,  degenerate »  and 
relevant  variables  4 


Let  Ax  —  b  ,  x  >  0 


characterize  the  linear  program; 


(1) 


Definition  1:  The  variable  x.  is  called  redundant  if  A  >  ct7  >  0 
- - - -  i  . . . .  i  — 

with  A  =  min  x^  subject  to  Ax  =  b  ,  x^  >  0,Vj  e  J 
where  the  set  J  is  chosen  to  Batisfy  J  c  N  ....  i  i  J.  (2) 

Definition  2\  The  variable  x^  is  called  p9eudo-deaenerate  if 

•»  « 

-cri  <  A  <  ct1  ,  with  a  ^  >  0 

Definition  3:  The  variable  x,  is  called  relevant  otherwise, 
-  x  - 

Remarks : 


i.e.  if  A  <  cr^  <  0  . 


1)  Definitions  1,  2  and  3  are  critically  dependent  on  the  set  J  c  N  , 
and  one  should  speak  of  relevant  variables  with  respect  to  J  ,  for 
instance. 

2)  If  we  assume  the  arithmetic  to  be  exact,  one  may  set  cr*  =  o\  =  0  . 

3)  The  partition  of  the  set  N  into  three  complementary  subsets  Redundant* 

I  .  .  I  ,  ,  is  not  unique;  this  is  not  a  burden, 

pseudo-degenerate  relevant 


however,  because  the  facial  decomposition  merely  requires  the  existence 
(and  choice)  of  one  such  partition. 


4. 


Definition  4:  A  set  X  c  N  is  called  minimal  if  one  has 


{x  |  Ax  =  b,  >  0  ,  Vi*  1}  c  (x  |  Ax  <*  b,  >  0  ,  VieN} 


and  each  variable  x^,  i»l  is  relevant  with  respect  to  the 
set  (I  -  (i))  . 

By  definition  a  minimal  set  of  non-negative  variables  characterizes  the 
same  feasible  region  as  the  original  L.P.;  furthermore,  if  one  assumes  that 
this  region  is  a  p-dimensional  (polyhedral)  set  P  ,  then  each  minimal  vari¬ 
able  x^,  1*1  identifies  a  (p-1) -dimensional  facet  F  of  P  which  can  be 
characterized  by  a  linear  program  obtained  from  the  previous  one  by  setting 
x^  *  0  ;  upon  determination  of  a  minimal  Bet  for  this  facet  F  (it  is  a  sub¬ 
set  of  I  ),  one  will  identify  (p-2)-dimensional  subfaces  of  P  J  and  so 
on...;  this  process  is  easily  seen  to  generate  the  finite  set  of  all  faces 
of  P  in  a  tree-like  manner.  More  details  concerning  this  construction 
can  be  found  in  [1], 

For  any  face,  the  definition  of  the  minimal  set  can  be  based  on  control 
parameters  cr*,  ct^  which  may  differ  from  zero;  this  will  produce  smaller 
minimal  sets,  whose  size  clearly  depends  on  the  numerical  value  of 

0-  «  *|*  m 

and  .  For  small  enough  values  of  and  ,  these  parameters 

will  merely  compensate  for  the  numerical  inaccuracy  of  the  computations  and 

only  those  "faces"  which  have  been  "created"  by  numerical  perturbations  will 

4>  «- 

be  discarded;  for  larger  values  of  and/or  ,  however,  only  a  subset 

of  the  actual  faces  of  P  will  be  generated.  In  fact  such  control  parameter 
introduce  a  choice  criterion  among  the  faces  of  P  ,  since  only  certain 
faces  will  be  generated  in  the  tree;  the  selected  few,  however,  can  be  seen 
to  range  through  all  dimensions  and  across  the  entire  tree. 


5. 


Of  course,  in  this  case, (since  not  all  the  faces  are  tested,  Bay,  for 
optimality)  one  will,  in  general,  merely  obtain  a  good  (usually  suboptimal) 
solution.  As  in  all  search  procedures  there  are  a  number  of  strategies  at 
our  disposition:  Typically  a  good  solution  should  be  rapidly  delivered  by 
the  algorithm  (a  variety  of  heuristic  guidelines  for  the  choice  of  a 
and  a for  each  tcN  can  be  used);  in  a  second  phase,  it  is  often  desirable 
to  spend  some  more  computing  time,  trying  to  establish  global  optimality,  or 
to  improve  the  current  best  solution;  this  is  easily  accomplished  in  the 
facial  decomposition  method  by  generating  some  new  faces  which  correspond  to 
variables  which  have  previously  been  classified  as  pseudo-degenerate,  during  the 
preceding  approximations.  (This  amounts  in  effect  to  lowering  the  value  ,cr  .) 
The  minimal  sets  need  not  be  recomputed,  but  merely  need  be  extended  by 
adjoining  to  them  some  pseudo-degenerate  variables;  since  all  index  sets  are 
finite,  the  search  will  eventually  terminate. 

It  would  be  futile  to  list  all  possible  algorithms  and  strategies  based 
on  facial  decomposition;  the  method  is  simple  and  flexible  enough  to  lend 
itself  to  special  structures  as  well  as  to  unstructured  problems. 

In  zero -one  programming,  the  facial  decomposition  approach  can  be  seen  to  be 
intimately  related  to  the  classical  branch  and  bounds  methods  because  of  the 
elementary  constraints  0  <  x^  <  1  (the  actual  comparison  is  left  to  the 
reader  as  an  exercise).  _  _  _ _ _ _ 

Thus  the  facial  decomposition  may  be  viewed  as  an  extension  towards 
less  structured  problems.  Possible  domains  of  application  in  concave, 
and  integer  programming  are  sketched  in  [1],  A  detailed  algorithm 
for  the  general  quadratic  algorithm  is  presented  in  [2]  and  extended 
in  [3].  Experimental  codes  seem  to  indicate  that  the  approach  is  powerful 
enough  to  motivate  further  analysis  both  theoretical  and  applied. 


2)  Cutting  planes 


The  tree  search  and  the  size  of  the  facial  tree  can  be  considerably 
curtailed,  if  one  introduces  (at  an  arbitrary  node)  some  additional 
extraneous  linear  constraint^) ;  valid  or  enumerative  cutting  planes  can 
be  used  for  this  purpose.  Enumerative  cuts  are  conditionally  val id . 

in  the  sense  that  they  require  some  additional  implicit  search  to  deter¬ 
mine  the  best  feasible  solution  which  they  may  cut  off;  any  of  the  well- 
known  search  methods  (typically  branch  and  bound)  can  be  used  for  this  purpose; 
thus  one  may  define  combined  algorithms  which  mash  facial  decomposition  and 
braneh  and  bound  into  one  another.  Here  facial  decomposition  assumes  the  role 
of  a  monitoring  device  which  remedies  the  inherent  difficulty  of  branch 
and  bound  to  cope  with  the  problem  of  feasibility. 

At  first,  it  may  seem  that  the  introduction  of  new  cuts  renders  the 
structure  of  the  feasible  polyhedral  set  more  complex  by  creating  a  host 
of  new  faces.  This  is  indeed  the  case,  but  the  situation  is  automatically 
taken  care  of  by  allowing  only  original  variables  (i.e.,  not  the  cut 
variables)  to  enter  minimal  sets. 

Definition  4';  A  set  I  c  N  is  called  minimal  if  one  has; 

{x*|  A'x*  **  b',  x'  >  0  ,  Viel  y  C]  c  {x'j  A'x'=  b',  x'  >  0  ,  VieK  y  C} 

and  each  variable  x^,  iel  is  relevant  with  respect  to  the 
set  (I-{i}>  U  C  , 

where  A'x'  «  b'  represent  an  extension  of  the  original 
L.P,  where  cuts  have  been  implemented;  C  is  the  index 
set  of  the  cut  variables. 


7. 


Hence  the  net  effect  of  cutting  planes  is  to  reduce  the  feasible 
set  (and  the  facial  tree)  without  introducing  new  nodes.  Hie  justifica¬ 
tion  of  this  approach  is  that  a 'tut  face" lies  entirely  in  the  face 
F  of  P  corresponding  to  the  node  for  which  the  cut  was  implemented; 
therefore  each  point  of  the  cut  face  lies  either  in  the  relative  interior 
of  F  (and  according  to  the  property  n  it  can  be  discarded)  or  it 
belongs  to  the  relative  boundary  of  F  and  it  is  considered  explicitly 
in  the  further  ramifications  of  the  facial  tree. 
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3)  Conclusions  ! 

\ 

We  indicate  that  both  the  cutting  plane  and  implicit  search  methods 

l 

can  be  profitably  imbedded  into  the  facial  decomposition  approach;  this 

results  in  a  reduction  of 'the  size  of  the  facial  tree,  without  any  adcli- 

\ 

tlonal  Dookkeeping  complications.  Preliminary  computational  experiraenta- 

\  '  ' 

tion  seems  to  indicate  that  the  monitoring  scheme  offered  by  the  facial 

decomposition  alio  reduces  the  size  of  implicit  search  and  Increases  the 
depth  and  efficiency  of  cutting  planes.  The  computational  efficiency  of 

a  method  of  this  type  is  not  easily  trafatable,  because  software  considera- 

\  • 

tions  visually  play  an  important  role;  furthermore  the  success  of  methods 

i 

in  the  area  of,  non-convex  mathematical  programming  is  usually  highly 

1  ' 

"problem  dependent."  However  the  following  heuristic  arguments ^can  be 

\ 

put  forward  to  validate  the  facial  decomposition  approach:  ! 

-  because  implicit  searck  is  performed  within  a  simplex  (in 
order  to  prove  the  validity  of  an  enumerative  cut)  it  usually 
ilp  quite  efficient. 

-  because  a  cutting  pl^ane  can  be  generated  in  a  lower  dimensional 

I 

face,  it^  depth  (within  that  face)  is  always  at  least  as  good  ( 
and  usually  better  than  if  the  cut  were  generated  in  a  higher 
dimensional  affine  space;  this  is  particularly  true  When 

degeneracy  occurs .  I 

! 

-  because  a  non-relevant  variable  generates  a  whole  subtree  in 

i 

i 

the  full  factorial  design  of  all  faces  (feasible  or  nof)  of 
P  ,  one  may  expect  an  exponential  payoff  in  risturn  for  the 
■  additional  pivoting  required  by  the  'construction  of  minimal  sets. 


\ 

I 


\ 

I 
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\ 

\  -  when  the  algorithm  terminates,  1  c  does  not  only  deliver  an 

I 

optimal  (or  currently  heat)  solution 'but  also  the  necessary 

i 

elements  -for  sensitivity  analysis  in  the  form  of  a  description 
of  the  facial  structure  about  this  solution. 

The  above  hortative  documentation  could  certainly  be  extended  in  ‘ 
many  other  directions,  especially  if  the  intrinsic  characteristics  of 
various  applications  are  taken,  into  account.  The  object  of  this  note, 
however!  is  not  to  claim  superior  numerical  results  but  primarily  to  > 
indicate  a  line  of  research;  the  facial  decomposition  approach  serins  prom¬ 
ising  enough  to  motivate  a  quest  for  more  results,  particularly  for  large 
>  \ 

and/or  structured  systems.  \ 


\ 
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